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The  Progress  Report 


This  report  is  the  third  quartly  report  for  the  project  of  locally  connected  adaptive 
Gabor  filter  for  real-time  motion  compensation,"  with  grant  number  N00014-94-1-0077, 
which  has  been  in  the  process  since  October  20th  of  1993  and  which  has  been  conducted 
under  the  supervision  of  the  principal  investigator,  Professor  Hua  Li  of  Texas  Tech 
University. 

As  at  the  third  quart  of  year  1,  the  project  has  been  making  progress  as  planned 
in  the  project  proposed,  1(b)  on  page  21.  In  particular,  the  following  work  heis  been 
accomplished  as  itemized  below: 

1.  The  software  has  been  developed  to  implement  the  Gabor  motion  detection  al¬ 
gorithm.  This  software  consists  of  utility  functions,  algorithm  modules,  and  test 
pattern  generators  for  the  experiments  and  verification  of  the  spatial  aind  temporal 
selectivity.  A  softwcire  program  mauual  now  is  under  developing.  A  fully  tested  , 
documented  program  will  be  provided  at  the  end  of  year  1  project. 

In  particular,  the  software  package  will  consist  of  the  following  programs: 

(a)  Programs  for  algorithm  implementation,  which  include: 

i.  Real  Gabor  kernel  generation  with  user-selectable  kernel  size,  spatial  fre¬ 
quency,  and  orientation  frequency; 

ii.  Imaginary  Gabor  kernel  generation  with  user-selectable  kernel  size,  spa¬ 
tial  frequency,  and  orientation  frequency; 

iii.  Image  convolution  program  with  user-selectable  kernels; 

iv.  Least  square  estimation  algorithm  for  solving  an  over-determined  linear 
system,  which  is  needed  at  the  last  phase  for  optical  flow  computation. 

(b)  Utility  programs  which  consist  of 

i.  The  program  generating  test  image  patterns.  The  program  allows  user 
to  define  the  observer’s  position  (camera  position),  the  fixation  direc¬ 
tion  of  the  camera,  and  the  orientation  of  the  projection  plane  (virtual 
film.)  It  also  allows  the  user  to  define  objects  in  three-dimensioncil  world- 
coordinated  system. 

ii.  The  progr2un  creating  animated  images.  The  progrctm  will  produce  e8K:h 
individual  frame  of  images,  and  generate  a  animated  image  sequence. 
These  two  programs  will  be  particularly  needed  to  test  and  verify  the 
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optical  flow  computation  based  on  the  generated  known  motion  of  the 
images. 

iii.  The  program  creating  postscript  files.  This  will  produce  the  hardcopy  of 
images,  and  computation  result. 

2.  Based  on  the  theoretical  analysis,  the  opticcd  flow  was  computed  for  several  artifi¬ 
cially  generated  test  patterns.  These  test  patterns  are  designed  to  test  the  concept 
of  spatial  and  orientation  selectivity  The  patterns  were  generated  by  using  virtual 
reality  technique  based  on  three-dimensional  computer  graphics.  As  described  in 
the  second  quartly  report,  they  include  stationzury  observer  while  object  is  moving, 
and  stationary  object  while  observer  is  moving,  as  well  as  both  observer  and  ob¬ 
ject  moving  in  a  known  fashion.  In  order  to  further  test  the  computation,  we  have 
modified  the  resolution  and  color  depth  of  each  pixel  to  make  them  all  120-by-100 
in  resolution  and  8-bit  color  per  pixel.  A  set  of  floppy  disks  are  now  prepared  for 
the  demonstration  purpose.  This  set  of  floppy  disks  will  be  provided  to  ONR  once 
fully  tested.  Included  in  this  set  of  disks  are  image  sequences  generated  under 
known  conditions  as  benchmark  for  the  future  testing  of  VLSI  implementation,  in 
particular,  they  include  the  following: 

(a)  An  observer  (camera)  is  stationary,  but  the  viewing  object  (a  sphere  with 
radius  equal  to  25  units)  is  moving  along  y-axis  5  units  per  frame. 

(b)  The  observer  is  moving  along  y-axis  5  units  per  freime  while  the  viewing  object 
is  stationary. 

(c)  Both  the  observer  and  the  viewing  object  are  moving  5  units  along  y-axis  cind 
z-axis  respectively. 

3.  In  addition  to  the  algorithm  development  and  verification,  we  have  also  started 
work  on  the  design  and  verification  of  the  electronics  basic  building  blocks  for  the 
VLSI  implementation.  This  early  start  of  the  hardware  design  concurrent  with  the 
algorithm  analysis  and  verification  will  further  ensure  the  quedity  of  the  work  in 
both  hairdware  and  software.  In  peirticular,  the  work  in  VLSI  implementation  at 
this  stage  includes 

(a)  Design  one  of  the  most  essential  building  blocks,  a  video  frequency  opAmp. 
With  extensive  SPICE  simulations  using  the  device  model  provided  from  MO- 
SIS  actual  fabrication  run,  we  have  completed  the  design.  The  characteristics 
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of  the  OpAmp  to  be  used  to  build  two-dimensional  convolution  unit  is  given 
in  a  research  memo  and  vras  included  in  the  2nd  quart  report  3is  Appendix  II. 

(b)  Design  amalog  multiplier,  which  is  to  be  used  for  building  two-dimension<il 
an2ilog  convolution  unit.  Extensive  SPICE  simulation  was  performed.  The 
preliminary  simulation  data  looks  very  positive  and  the  circuit  layout  design 
was  started. 

(c)  Post-layout  SPICE  simulation  is  under  way  to  check  the  victual  VLSI  imple¬ 
mentation.  The  result  will  be  documented  and  reported  accordingly. 

4.  In  order  to  benchmark  the  VLSI  chips,  a  hardware  prototype  board  is  under  design 
and  construction.  This  board  will  be  used  to  compare  the  performance  of  digital 
approach  vs.  analog  approach,  anzJog  approach  baised  on  the  steindaxd  off-the 
shelf  components  vs.  analog  customer-design  VLSI  approach.  The  board  is  to  be 
operating  in  the  4th  quarter.  The  board  is  designed  with  a  486  machine  as  a  host. 
The  prototype  demonstration  will  be  scheduled  with  ONR. 

As  briefly  summaried  here,  the  project  has  been  making  progress  as  planned.  In  the 
next  phase,  at  the  end  of  one  year  of  the  project,  we  plan  to  report  our  progress  with 
softwcure  manual,  demonstration  program,  zind  prototype  board  demonstration. 

The  End. 
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